Electronic device, audio device, electronic device control method and storage medium

ABSTRACT

An electronic device equipped with a processor, wherein the processor, when an audio device is connected which has a sound emission section which outputs a sound and a sound reception section in which a sound is inputted, instructs the audio device to acquire unique authentication information, and wherein the processor performs personal authentication of a user wearing the audio device based on the authentication information from the audio device.

CROSS-REFERENCE TO RELATED APPLICATION

This application is based upon and claims the benefit of priority fromthe prior Japanese Patent Application No. 2017-185084, filed Sep. 26,2017, the entire contents of which are incorporated herein by reference.

BACKGROUND OF THE INVENTION 1. Field of the Invention

The present invention relates to an electronic device having a personalauthentication function to identify a user, an audio device, anelectronic device control method and a storage medium.

2. Description of the Related Art

In recent years, remarkable is spread of a smart phone, a tabletterminal, a portable game machine, and a portable electronic device suchas various types of electronic learning devices including an electronicdictionary. In recent years, in particular, a type and amount ofinformation which can be stored and accessed have become huge byenhancing performance of an electronic device, achieving a largercapacity of a built-in memory, and forming the built-in memory into acloud through a communication channel. In addition to such a background,under the assumption that a portable electronic device is basically usedonly by a user, cases have increased where various information and dataunique to a user (hereinafter referred to as “personal data”collectively) are stored in an electronic device.

On the other hand, in accordance with the spread of portable electronicdevices in recent years, their usage has increased in an education fieldsuch as a school or a coaching school and a field of individual learningrelated to English conversation or a certification examination. For thatreason, it is required to improve certainty of protection of personaldata such as a learning plan and the progress thereof and an achievementlevel (results) of learning.

In such a portable electronic device, in order to restrict access topersonal data other than a user, a method of identifying a user bypersonal authentication technology using a password, a pattern, and anbiological information unique to the user which are set up in advance isadopted generally. For example, as personal authentication technologyusing biological information, one which uses an vein image, a fingerprint, a voiceprint, a shape of a face, and an iris of an eye or thelike as is described in Japanese Patent Application Laid-Open (Kokai)Publication No. 2012-164357 is known. Incidentally, such personalauthentication technology is widely used also as a method of restrictingaccess to important information or confidential information in thegovernment, municipal offices, an educational institution and anonfinancial company or the like.

The present invention is advantageous in that an electronic device, anaudio device, an electronic device control method and a storage mediumare provided by which personal authentication can be performed by asimple and suitable method and whereby personal data can be usedappropriately.

SUMMARY OF THE INVENTION

In accordance with one aspect of the present invention, there isprovided an electronic device comprising: a processor, wherein theprocessor, when an audio device is connected which has a sound emissionsection which outputs a sound and a sound reception section in which asound is inputted, instructs the audio device to acquire uniqueauthentication information, and wherein the processor performs personalauthentication of a user wearing the audio device based on theauthentication information from the audio device.

In accordance with another aspect of the present invention, there isprovided an audio device comprising: a sound emission section whichoutputs a sound; and a sound reception section in which a sound isinputted, wherein the audio device, when an electronic device isconnected thereto, outputs to the electronic device uniqueauthentication information acquired in accordance with an instructionreceived from the electronic device so as to acquire the authenticationinformation.

In accordance with another aspect of the present invention, there isprovided a control method for an electronic device, comprising:transmitting an instruction signal to an audio device connected to theelectronic device; acquiring, from the audio device, uniqueauthentication information of a user based on an echo wave of a soundoutputted from the audio device to the user wearing the audio device inresponse to the instruction signal; and performing personalauthentication of the user based on the authentication information.

In accordance with another aspect of the present invention, there isprovided a non-transitory computer-readable storage medium having storedthereon a program that is executable by a computer in an electronicdevice to actualize functions comprising: transmitting an instructionsignal to an audio device connected to the electronic device; acquiring,from the audio device, unique authentication information of a user basedon an echo wave of a sound outputted from the audio device to the userwearing the audio device in response to the instruction signal; andperforming personal authentication of the user based on theauthentication information.

The above and further objects and novel features of the presentinvention will more fully appear from the following detailed descriptionwhen the same is read in conjunction with the accompanying drawings. Itis to be expressly understood, however, that the drawings are for thepurpose of illustration only and are not intended as a definition of thelimits of the invention.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1A and FIG. 1B are each a schematic diagram showing an embodimentof an electronic device according to the present invention;

FIG. 2A is a drawing showing an example of a function block of theelectronic device according to the embodiment, and FIG. 2B and FIG. 2Care each a drawing showing an example of a function block of an audiodevice connected to the electronic device;

FIG. 3 is a flowchart showing an example of a control method for theelectronic device according to the embodiment;

FIGS. 4A and 4B are screen transition diagrams showing an example of thescreen display of a learning plan (at the time of authentication) thatis executed in the electronic device according to the embodiment;

FIG. 5 is a diagram showing a modification example applicable to theelectronic device according to the embodiment; and

FIG. 6 is a flowchart showing an example of a control method for theelectronic device according to the modification example of theembodiment.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Hereafter, embodiments of an electronic device, an audio device, acontrol method for the electronic device, and a storage medium accordingto the present invention will be described in detail. In the presentembodiment, a case is described in which the electronic device and theaudio device according to the present invention are applied to anelectronic learning device.

(Electronic Device)

FIG. 1A and FIG. 1B are each a schematic diagram showing an embodimentof the electronic device according to the present invention. FIG. 1A isa drawing showing a first example (wired connection) of a connectionconfiguration between the electronic device and the audio device, andFIG. 1B is a drawing showing a second example (wireless connection) of aconnection configuration between the electronic device and the audiodevice. FIG. 2 A to FIG. 2C are block diagrams showing an example offunction configurations applied to the electronic device according tothe present embodiment. FIG. 2A is a drawing showing an example of afunction block of the electronic device, and FIG. 2B and FIG. 2C areeach a drawing showing an example of a function block of the audiodevice connected to the electronic device.

The electronic device according to the present embodiment is anelectronic learning device which is used for foreign language learningincluding English-conversation learning or is applied to an electronicdictionary etc. In the electronic device 100 of the present embodiment,an audio device 200 can be wired or wirelessly connected so that datacommunication is possible having an input/output function for listeningto the sound of a voice or the like based on data inputted from theelectronic device 100 and then outputting emitted sound such as voice tothe electronic device 100 as data, as shown in FIG. 1A and FIG. 1B.

For example, the electronic device 100 has a function to aurally orvisually provide the user with information such as English words,English sentences, explanatory notes, and the like based on a learningplan set in advance and/or search results of words and phrases. Inaddition, the electronic device 100 has a function to aurally providethe user with information such as English words, English sentences, andexplanatory notes by a voice and/or a musical sound via the audio device200 worn in an ear, judge a speaking or talking level, and search wordsand phrases based on a voice inputted by the user. In addition, theelectronic device 100 has a function to perform personal authenticationprocessing by acquiring authentication information based on biologicalinformation unique to the user from the audio device 200 worn in theuser's ear.

The electronic device 100 mainly includes, for example, a displaysection 110, an input operation section 120, an interface section(hereinafter abbreviated as “I/F section”) 130, an arithmetic processingsection 140, a memory section 150, and a power supply section 160, asshown in FIG. 2A.

The display section 110 includes a liquid crystal display (LCD), anorganic electroluminescence display (ELD), an electronic paper display,or the like capable of displaying characters, numbers, illustrations,graphs, and the like, and displays various pieces of information basedon operations performed by the user via the input operation section 120or processing performed inside the electronic device 100. The inputoperation section 120 includes, for example, button switches 12, 14 and16 constituted by hardware keys arranged around the display section 110or on a side portion or the like of the housing of the electronic device100, and a touch switch 18 which is a software key using a touch panelformed integrally with the display section 110, as shown in FIG. 1A andFIG. 1B.

Here, in a case where the electronic device 100 is applied to awidely-used electronic learning device such as an English-conversationlearning machine or an electronic dictionary as shown in FIG. 1A andFIG. 1B, as the input operation section 120, a selection key and adetermination button for selecting examination sentences according tomenus or learning plans displayed on the display section 110 and othervarious items, a play button for performing voice-outputting of Englishwords, English sentences, or explanatory notes displayed on the displaysection 110, and a function key and a menu key for performing or settingvarious functions such as data communication with the audio device 200and personal authentication processing for identifying a user areprovided in the form of a hardware key or a software key. For example,the selection key and the determination button are the button switch 12and the touch switch 18, the play button is the button switch 14, andthe function key and the menu key are the button switch 16 and the touchswitch 18. By operating these switches, the user displays desiredEnglish words, English sentences, or explanatory notes on the displaysection 110 so as to output a voice from the audio device 200, displaysa learning progress or an achievement level of the user on the displaysection 110, or selects various types of functions and/or menus.

The I/F section 130, which functions at least as an interface forperforming data communication between the electronic device 100 and theaudio devices 200 connected to the electronic device 100, transmits anoutput signal for outputting (emitting) a voice or a musical sound fromthe audio device 200, and receives a voice or the like inputted into(received by) the audio device 200 as an input signal. In addition, theI/F section 130 transmits an authentication instruction signal to theaudio device 200 in accordance with an instruction from the arithmeticprocessing section 140, and receives an echo signal based on an echowave acquired by the audio device 200.

Here, for data communication by the I/F section 130, a wiredcommunication method where data communication is performed via anearphone cable 26 as shown in FIG. 1A, or a wireless communicationmethod where data communication is performed by a widely used wirelesscommunication standard such as Wi-Fi (wireless fidelity (registeredtrademark)) or Bluetooth (registered trademark) as shown in FIG.1B isadopted. In a case where the wired communication method is adopted fordata communication with the audio device 200, the I/F section 130includes an earphone jack 20 for transmitting or receiving signals suchas voices to or from the audio device 200 as shown in FIG. 1A.

Note that the I/F section 130 maybe one which is connected to a networkwhere public use of the Internet is possible or to a limitedly availablenetwork which is provided by a specific organization such as a companyor an educational institution, and has a function to serve as aninterface for transmitting or receiving data stored in the memorysection 150 or data stored in a server on a network to or from theserver.

The arithmetic processing section 140 includes a processor such as a CPU(Central Processing Unit) and an MPU (Microprocessor) or a computerprovided with the processor, and executes a control program in a storagemedium stored in the memory section 150. As a result, the arithmeticprocessing section 140 controls the display of the user's desiredEnglish word or English sentence, explanatory note, a learning progress,an achievement level, a menu, and the like on the display section 110 inaccordance with the user's operations on the input operation section120, controls the input or output of a voice in the audio device 200,and controls various functions such as processing for judging a speakinglevel or a conversation level based on a received voice or the like.

In the present embodiment, in particular, the arithmetic processingsection 140 executes a control of transmitting an authenticationinstruction signal to the audio device 200 connected to the I/F section130 and receiving an echo signal based on an echo wave reflected insidethe user's earhole. Then, the arithmetic processing section 140 executespersonal authentication processing to identify the user wearing theaudio device 200 based on the received echo signal, judges the proprietyof access to the personal data of the user in accordance with a resultof the authenticating processing, and controls an execution state oflearning plans and/or functions using the personal data.

The memory section 150 includes a RAM (Random Access Memory) and a ROM(Read Only Memory), and data of an English word, an English sentence,and a search phrase inputted or instructed by a user by an operation onthe input operation section 120, data associated with various functionsas the electronic learning device, and data associated with personalauthentication processing that is executed based on data communicationwith the audio device 200 are stored in the RAM. In addition, a controlprogram and the like that are executed in the arithmetic processingsection 140 are stored in the ROM.

Note that the memory section 150 may have a configuration where at leasta part of the ROM is included in the arithmetic processing section 140.In this configuration, the control program may be incorporated in thearithmetic processing section 140 in advance. In addition, the memorysection 150 may be structured such that it is partially or entirely inthe form of a removable storage medium such as a memory card, and isremovable from the electronic device 100. In addition, theabove-described data or the like related to personal authenticationprocessing may be partially or entirely stored in a server or the likeon a network connected via the I/F section 130, in place of the memorysection 150.

The power supply section 160 supplies a driving electric power to eachsection of the electronic device 100. To the power supply section 160,not only a widely used primary battery or rechargeable battery as anoperating power source but also an electric power source or the like maybe applied which is based on environmental power generation (energyharvesting) technology where an electric power is generated based onenergies such as vibration, light, heat, and electromagnetic waves.

The audio device 200, which is an audio device (headset) such asearphones with inner or canal type microphones, is worn in the user'sears or worn on the head, and can input or output a voice or the like.The audio device 200 is connected such that data communication with theelectronic device 100 is possible, and has a function to output (emit) avoice or a musical sound in accordance with an output signal from theelectronic device 100 and transmit an input signal in accordance with avoice or the like inputted (received) from the user to the electronicdevice 100. In addition, the audio device 200 has a function to acquirebiological information unique to the user as authentication informationbased on an instruction from the electronic device 100.

When a wired connection is enabled in the electronic device 100 as shownin FIG. 1A, the audio device 200 is mainly constituted by a soundemission section 210, a sound reception section 220 and an I/F section230 as shown in FIG. 2B. Also, when a wireless connection is enabled inthe electronic device 100 as shown in FIG. 1B, the audio device 200 ismainly constituted by the sound emission section 210, the soundreception section 220, the I/F section 230, an arithmetic processingsection 240, the memory section 250 and the power supply section 260 asshown in FIG. 2C. Here, the descriptions are simplified for theequivalent sections in above-described electronic device 100.

The sound emission section 210, which is sound emission means such as anearphone or a speaker provided in a housing 22 that is worn in the user's earhole, receives an output signal transmitted from the electronicdevice 100 via the I/F section 230, converts it into a sound signal suchas a voice or a musical sound, and outputs it inside the user's earholewearing the audio device 200. In addition, the sound emission section210 converts an authentication instruction signal transmitted from theelectronic device 100 into an acoustic wave having a specific frequency,and outputs it into the user's earhole as an authentication wave.

The sound reception section 220, which is sound collection means such asa microphone provided in the above-described housing 22, converts avoice or the like inputted from the user via the user's externalauditory canal into an electrical signal and transmits it to theelectronic device 100 as an input signal via the I/F section 230. Inaddition, the sound reception section 220 converts an echo wave inputted(taken in) by an authentication wave outputted from the sound emissionsection 210 being reflected inside the user's earhole into an electricalsignal and transmits it to the electronic device 100 as an echo signalvia the I/F section 230. Here, the echo wave inputted into the soundreception section 220 or the echo signal based on the echo wavecorresponds to authentication information based on biologicalinformation unique to the user.

The I/F section 230, which functions as an interface for performing datacommunication with the electronic devices 100 connected to the audiodevice 200, receives an output signal for outputting (emitting) a voiceor a musical sound from the sound emission section 210 (emitting sound),and transmits a voice or the like inputted into the sound receptionsection 220 (receiving sound) as an input signal. In addition, the I/Fsection 230 receives an authentication instruction signal transmittedfrom the electronic device 100, and transmits an echo signal based on anecho wave inputted into the sound reception section 220 to theelectronic device 100.

Here, in the case of a wired connection of the audio device 200 to theelectronic device 100, the I/F section 230 includes an earphone plug 24and an earphone cable 26 as shown in FIG. 1A, and performs datacommunication with the electronic device 100 by the earphone plug 24being inserted into and electrically connected with the earphone jack 20in the I/F section 130 of the electronic device 100. In addition, in thecase of a wireless connection of the audio device 200 to the electronicdevice 100 as shown in FIG. 1B, the I/F section 230 performs datacommunication with the electronic device 100 by widely used wirelesscommunication standards such as Wi-Fi (wireless fidelity (registeredtrademark)) described above, Bluetooth (registered trademark), or nearfield communication (NFC) as non-contact communication.

The arithmetic processing section 240, in the case where the audiodevice 200 is wirelessly connected to the electronic device 100,includes a processor such as a CPU, an MPU, or a computer, and executesa prescribed control program stored in the memory section 250. As aresult, the arithmetic processing section 240 controls a wirelessconnection state with the electronic device 100 in the I/F section 230,and controls transmission or reception of a signal such as a voice or asignal associated with personal authentication processing.

The memory section 250 has stored therein a control program or the likethat is executed in the arithmetic processing section 240. Here, thememory section 250 may be partially included in the arithmeticprocessing section 240 and, in that case, the control program may beincorporated in the arithmetic processing section 240 in advance.

The power supply section 260 supplies driving electric power to eachsection of the audio device 200. To the power supply section 260, awidely used primary battery or rechargeable battery as an operatingpower source are applicable, for example. Here, the audio device 200 isactivated by driving electric power being supplied to each section fromthe power supply section 260 in accordance with an operation on anelectric power switch not shown, and then an operation to establishwireless connection to the electronic device 100 is executed.

In the present embodiment, as means for inputting or outputting theuser's voice or the like, only the audio device 200 such as an earphonewith a microphone has been described which can be wired or wirelesslyconnected to the I/F section 130 of the electronic device 100. However,the present invention is not limited thereto. That is, the electronicdevice 100 may be structured to have a sound section therein which isconstituted by a microphone and a speaker for outputting and inputtingthe user's voice or the like, in addition to the above-described audiodevice 200.

(Control Method for Electronic Device)

Next, a control method and a control program for the electronic device100 according to the present embodiment are described with reference tothe drawings. Here, a case is described in which the electronic device100 has been applied to an electronic learning device forEnglish-conversation learning such as those shown in FIG. 1A and FIG.1B.

When the electronic device 100 is activated before an authenticationsetup, the arithmetic processing section 140 performs initial settingfor authentication. Specifically, in the case of wired connection, whenthe earphone plug 24 of the audio device 200 is inserted into theearphone jack 20 of the electronic device 100, the arithmetic processingsection 140 judges whether there is any authentication data registeredin the memory section 150 or an external server. When there is noregistration data, the arithmetic processing section 140 of theelectronic device 100 outputs an authentication instruction signal tothe audio device 200 via the I/F section 130. Then, the audio device 200outputs an authentication wave from the sound emission section 210 inaccordance with the authentication instruction signal received from theI/F section 230. The user wears the audio device 200 in the ears, anecho wave created by an authentication wave being echoed inside theuser's ear is inputted into the sound reception section 220, and thesound reception section 220 outputs an input signal according to theecho wave. The audio device 200 outputs the input signal from the I/Fsection 230 and, when the input signal received from the I/F section 130or a component which has been extracted from the input signal and bywhich the individual can be specified is stabilized, the electronicdevice 100 registers the input signal or the component into the memorysection 150 or the external server.

In the case of wireless connection, when a connection is established bypredetermined wireless communication standards between the electronicdevice 100 and the audio device 200, the arithmetic processing section140 of the electronic device 100 judges whether there is anyauthentication data registered into the memory section 150 or theexternal server. When there is no registration data, the arithmeticprocessing section 140 outputs an authentication instruction signal tothe audio device 200 via the I/F section 130. Then, the audio device 200outputs an authentication wave from the sound emission section 210 inaccordance with the authentication instruction signal received from theI/F section 230. The user wears the audio device 200 in the ears, anecho wave created by an authentication wave being echoed inside theuser's ear is inputted into the sound reception section 220, and thesound reception section 220 outputs an input signal according to theecho wave. The audio device 200 outputs the input signal from the I/Fsection 230 and, when the input signal received from the I/F section 130or a component which has been extracted from the input signal and bywhich the individual can be specified is stabilized, the electronicdevice 100 registers the input signal or the component into the memorysection 150 or the external server.

FIG. 3 is a flowchart showing an example of the control method for theelectronic device 100 according to the present embodiment, FIGS. 4A and4B are screen transition diagram diagrams showing an example of thescreen display of a learning plan (at the time of authentication) thatis executed in the electronic device 100 according to the presentembodiment.

In the control method for the electronic device 100 according to thepresent embodiment, processing is performed to judge the propriety ofthe execution of personal authentication processing related to the userbased on the connection state of the audio device 200 to the electronicdevice 100. In addition, personal authentication processing is performedto identify the user based on authentication information acquired by theaudio device 200. Furthermore, processing is performed to judge thepropriety of access to the personal data of the user based on the resultof the personal authentication processing, and to control the executionstate of a learning plan or function using the personal data. Theseprocessing operations are actualized by a specific program beingexecuted in the arithmetic processing section 140 of the electronicdevice 100, or the arithmetic processing section 140 of the electronicdevice 100 and the arithmetic processing section 240 of the audio device200.

In the control method for the electronic device 100 according to thepresent embodiment, when the audio device 200 is enabled with a wiredconnection to the electronic device 100 as shown in FIG. 1A, and theuser activates the electronic device 100 (Step S302), the arithmeticprocessing section 140 controls the electronic device 100 to be held ina wait state until the earphone plug 24 of the audio device 200 isinserted into the earphone jack 20 of the electronic device 100 andelectrically connected as shown in a flowchart of FIG. 3. Note that aconfiguration may be adopted in which, when the earphone plug 24 of theaudio device 200 is inserted into the earphone jack 20 of the electronicdevice 100 in a sleep state where main functions other than a functionto detect insertion to the earphone jack 20 have been suspended, theelectronic device 100 is activated.

On the other hand, when the audio device 200 is enabled with a wirelessconnection to the electronic device 100 as shown in FIG. 1B, and theuser activates the electronic device 100 and the audio device 200 (StepS302), the arithmetic processing sections 140 and 240 controls theelectronic device 100 and the audio device 200 to be held in a waitstate until the connection state based on the predetermined wirelesscommunication standards is established between the electronic device 100and the audio device 200. Here, when the electronic device 100 isactivated, the arithmetic processing section 140 displays a home screen(or menu screen) such as that shown in FIG. 4A (a) on the displaysection 110. On the home screen, a menu list and icons (such as“SPEAKING”, “PRONUNCIATION TRAINING”, “ENGLISH CONVERSATION A”)indicating various types of learning plans and setting items inEnglish-conversation learning are displayed.

In this waiting state, the arithmetic processing section 140 monitors tojudge whether or not the audio device 200 has been wired or wirelesslyconnected to the electronic device 100, constantly or at predeterminedtiming (Step S304). When judged that the audio device 200 has not beenconnected (No at Step S304), the arithmetic processing section 140maintains the above-described waiting state. When judged that the audiodevice 200 has been connected (Yes at Step S304), the arithmeticprocessing section 140 executes processing (authentication informationacquisition processing) for acquiring authentication information uniqueto the user wearing the audio device 200 in the ears.

In this authentication information acquisition processing, thearithmetic processing section 140 first transmits an authenticationinstruction signal for acquiring the authentication information uniqueto the user to the audio device 200 via the I/F section 130 (Step S306).When the authentication instruction signal transmitted from theelectronic device 100 is received via the I/F section 230, the audiodevice 200 converts the authentication instruction signal into anacoustic wave having a specific frequency in the sound emission section210 and outputs the acoustic wave into the user's earhole as anauthentication wave (Step S308). Then, the authentication wave outputtedfrom the sound emission section 210 is reflected inside the user'searhole and inputted into the sound reception section 220 as an echowave. The audio device 200 converts this echo wave into an electricalsignal (Step S310) and transmits it to the electronic device 100 as anecho signal via the I/F section 230 (Step S312).

Next, when the electronic device 100 receives the echo signaltransmitted from the audio device 200 via the I/F section 130, thearithmetic processing section 140 executes personal authenticationprocessing which identifies the user based on the authenticationinformation included in the echo signal (Step S314).

More specifically, it is known that the shape of the human earholegenerally differs for each individual. Accordingly, in the presentembodiment, attention is focused on audio devices, such as earphoneswith a microphone which are indispensable components in electroniclearning devices, such as English-conversation learning machines. Theauthentication wave is outputted to the user's earhole wearing the audiodevice 200, and an echo wave acquired by the authentication wave beingreflected in accordance with the shape of the inside of the earhole andinputted is received as an echo signal. The arithmetic processingsection 140 acquires the waveform (namely, acoustic properties insidethe earholes) of the echo wave contained in the echo signal asauthentication information unique to the user, and executes personalauthentication processing to authenticate the user by comparing theauthentication information with authentication information (acousticproperties inside the earholes) stored (registered) in advance in thememory section 150 or the like.

In this method for acquiring authentication information unique to auser, the inner or canal type earphone applied as the audio device 200can be worn in the user's earhole with it being in close contact withthe earhole. Therefore, this acquisition method has an advantageouseffect in that an echo wave corresponding to the shape of the inside ofan earhole can be favorably acquired, whereby personal authenticationprocessing for identifying a user can be appropriately performed.

In the above-described personal authentication processing (Step S314),when the user who is currently using the electronic device is identifiedand the user is authenticated to be the person registered in advance(Yes at Step S314), the arithmetic processing section 140 permits theuser to access personal data such as data accumulated in relation to theuser and information registered by the user in the past (Step S316), andexecutes browsing or updating of the personal data, or performs alearning plan or a function using the personal data (Step S318).

Here, permitting access to the personal data at the above-described StepS316 means not only allowing to read and brows past records such aslearning plans or learning results of the user from the memory section150, but also allowing to newly create personal data or to performupdate and store of data.

The learning plan using the personal data at the above-described StepS318 is described using English-conversation learning as an example.First, when the user of the electronic device 100 is authenticated, thearithmetic processing section 140 changes display as shown in FIG. 4A(b)by changing the menu list, the design of an icon, brightness, and thelike on the home screen on the display section 110 shown in FIG. 4A(a),and displays a message indicating that the user has been authenticatedso as to notify the user of the change to a state of being authenticatedor a state where a learning plan using personal data can be performed.The initial screen at the time of personal authentication may be thehome screen or a screen displayed last time by the authenticated userending operations.

Next, when the user selects an arbitrary item on the menu list(“PRONUNCIATION TRAINING” in FIG. 4A(b)) on the home screen, thearithmetic processing section 140 reads the personal data of the userfrom the memory section 150, and executes the selected learning plan.Next, the arithmetic processing section 140 performs display forinputting execution conditions in the learning plan (“QUESTION SETTINGMETHOD” shown in FIG. 4A(c), “RANGE OF QUESTIONS” shown in FIG. 4A(d)),and the like into the display section 110. Here, the arithmeticprocessing section 140 refers to a past record related to the samelearning plan executed by the user in the past and, if there is aquestion range that has not been given, displays this range on the menulist as a range of questions.

Then, when the user inputs arbitrary execution conditions and the like,the arithmetic processing section 140 gives an example sentence based onthese conditions as shown in FIG. 4A(e) by displaying it on the displaysection 110, and replays and outputs a voice pronouncing the examplesentence with a typical (that is, native) accent via the audio device200. Here, after replaying and outputting this model voice pronouncingthe example sentence, the arithmetic processing section 140 displays onthe display section 110 a message prompting the user to pronounce theexample sentence. When the user inputs the example sentence via theaudio device 200 in response to the message, the arithmetic processingsection 140 records this user's voice, as shown in FIG. 4A(f).

Next, the arithmetic processing section 140 executes pronunciationanalysis processing based on comparison between the user's recordedvoice data and the model voice data for the given example sentence, asshown in FIG. 4B(g). Here, for example, elements such as smoothness,contrast, consonant strength, reading-aloud time and the like of thepronunciation are compared against the user's pronouncing. After the endof the pronunciation analysis processing, the arithmetic processingsection 140 displays an analysis result on the display section 110 inthe form of a score, a circle graph, etc. which are easier tounderstand, as shown in FIG. 4B(h). Here, when an analysis result of thesame learning plan executed by the user in the past (for example, lasttime) has been accumulated in the memory section 150, the arithmeticprocessing section 140 displays such that comparison between theanalysis result acquired this time and the previous analysis result canbe performed. In addition, the result (namely, learning result) of thepronunciation analysis processing acquired this time is stored forupdating, or newly stored as personal data in the memory section 150together with the progress status and the like of the learning plan. Asa result, the user can accurately grasp change in the user's achievementlevel related to pronunciation and reflect it in the improvement of theachievement level in the future.

After the series of processing for the learning plan is completed, whenthe electronic device is not ended (is continued to be used) (No at StepS320), the arithmetic processing section 140 returns to Step S318 anddisplays the home screen again on the display section 110, and continuesthe state where the user can access the personal data or execute alearning plan using the personal data. On the other hand, when the audiodevice 200 is removed from the electronic device 100 and the userperforms a turn off operation on the electric power switch (Yes at StepS320), the arithmetic processing section 140 ends or suspends all theoperations in the electronic device. Note that this end judgmentprocessing at Step S320 is performed not only when the series ofprocessing for the learning plan is ended, but also when the audiodevice 200 is removed from the electronic device 100 or a turn offoperation is performed on the electric power switch by the user duringthe learning plan. In this case, the arithmetic processing section 140records, as a log, the progress state and the learning result of thelearning plan updated or newly created before the operation of theelectronic device is ended or suspended so as to update the personaldata or store the log as new personal data in the memory section 150

On the other hand, in the above-described personal authenticationprocessing (Step S314), when the user currently using the electronicdevice is not authenticated to be the person registered in advance (Noat Step S314), the arithmetic processing section 140 does not permitaccess to the user's personal data registered in advance (Step S322),provides a notification by displaying an message indicating that theuser is not authenticated (Step S324), and ends or suspends all theoperations in the electronic device 100 so that the electronic device100 enters a state of not being used.

Note that a configuration may be adopted in which, in theabove-described personal authentication processing (Step S314), thearithmetic processing section 140 judges adequacy in advance withrespect to the waveform (namely, acoustic properties inside theearholes) of the echo wave acquired by the audio device 200. That is,when judged that the echo wave is not suitable for the personalauthentication processing because the wave amplitude of the reflectedwave is very small, a noise component has been significantly mixedthereinto, or the like, the arithmetic processing section 140 repeatedlyexecutes processing to acquire an echo wave (Steps S306 to S312) whilerepeatedly transmitting an authentication instruction signal to theaudio device 200 until an echo signal based on an effective echo wave isacquired. This processing to acquire an echo signal is repeatedlyexecuted by a predetermined number of times or for a predeterminedperiod and, when no effective echo signal is acquired the predeterminednumber of times or within the predetermined period, the arithmeticprocessing section 140 does not permit access to the personal data aswith the above-described Steps S322 and S324, and ends or suspends allthe operations in the electronic device 100, so that the electronicdevice 100 enters a state of not being used after displaying on thedisplay section 110 a message indicating that the user is notauthenticated.

Also, a configuration may be adopted in which, when the user is notauthenticated (No at Step S314) in the above-described personalauthentication processing (Step S314), the arithmetic processing section140 executes a series of processing operations (non-permission of accessto personal data, execution of a learning plan which does not usepersonal data, and judgment to end the electronic device) of Steps S622to S626 shown in the modification example (flowchart of FIG. 6)described later, in place of the processing operations shown in theabove-described Steps S322 to S324.

As described above, in the configuration of the present embodiment wherethe audio device 200 is connected to the electronic device 100 and used,personal authentication processing which identifies a user wearing theaudio device 200 is executed, and the propriety of access to thepersonal data of the user is judged based on an echo wave acquired by anauthentication wave outputted from the sound emission section 210 of theaudio device 200 being echoed inside the user's earhole and inputtedinto the sound reception section 220.

As a result of this configuration, by using an audio device which isused for usual operations (learning plans and the like) in an electronicdevice, a user can execute personal authentication processing whichappropriately identifies the user only by wearing the audio device inthe ears as a series of learning preparations without performing anoperation aimed only at personal authentication, and can favorably viewor update the personal data of the user, or use a learning plan or afunction using the personal data, without adding new components to theelectronic device. In particular, since the enhancement of conversationcapability is considered as important in a field of language learningincluding a field of school education, products using earphones orheadphones having a microphone function have become widely used forelectronic learning devices for conversation learning for the languageof each country. The present invention can be favorably applied to theseelectronic devices.

In the present embodiment, when a user change is to be made from aregistered user A to an unregistered user B, or when the unregistereduser B is additionally registered as a user in addition to theregistered user A, the registered user A performs a series of personalauthentication operations where the processing of Step S302 to Step S314are executed using the audio device 200 and the electronic device 100,so that a state is achieved in which a registration change or anadditional setup can be performed. Then, the electronic device 100enters a mode for a registration change or an additional registration byan input operation for registration being performed by the inputoperation section 120 of the electronic device 100. Thereafter, the userB performs initial setting for the above-described authentication,whereby the registration is completed. In a case where a registered useris deleted, the same operations are performed except that, in place ofthe input operation for registration, an input operation for deletion isperformed by the input operation section 120 of the electronic device100.

MODIFICATION EXAMPLE

Next, a modification example applicable to the above-describedembodiment is described. FIG. 5 is a diagram showing modificationexamples applicable to the electronic device according to the presentembodiment. FIG. 6 is a flowchart showing an example of an electronicdevice control method according to present modification. Here,descriptions of processing operations that are the same as those of theabove-described embodiment are omitted.

In the above-described embodiment, the electronic device 100 judges thatthe audio devices 200 such as earphones with a microphone has beenconnected, acquires authentication information based on biologicalinformation unique to the user, and performs personal authentication.That is, in the above-described embodiment, the audio device 200 isjudged to have been connected under the assumption that this audiodevice 200 connected to the electronic device 100 is earphones or thelike with a microphone suitable for the above-described processing foracquiring authentication information unique to the user (for example, aregular product specified by a maker of electronic devices or a productof quality according to that), and the processing for acquiringauthentication information and personal authentication processing foridentifying the user are executed with the judgment as a trigger.

In the modification example according to the present embodiment, theelectronic device 100 is structured to have a built-in sound sectionwhich inputs or outputs a voice, and a control method is adopted whichcan support a case where earphones having no microphone function(earphones without a microphone) is connected as the audio device 200.

Specifically, as an operational mode, the electronic device 100 has anexternal microphone mode which enables (or prioritizes) the input oroutput of a voice or the like via earphones with a microphone connectedas the audio device 200, and a main body microphone mode which enables(or prioritizes) the input or output of a voice or the like via thebuilt-in sound section in the electronic device 100. As a result, theoperation state of the electronic device 100 is controlled in accordancewith each mode.

(External Microphone Mode)

For example, in the case where the electronic device 100 is in the“external microphone mode” which enables the input or output of a voiceor the like via earphones with a microphone as shown in FIG. 5, whenearphones with a regular microphone are connected to the I/F section 130as the audio device 200 (Yes at Step S604) as shown in the flowchart ofFIG. 6, the arithmetic processing section 140 maintains the setting ofthe external microphone mode as it is. Then, the arithmetic processingsection 140 executes a series of processing operations (authenticationinformation acquisition processing, personal authentication processing,learning plan execution operation, and judgment as to the end of theelectronic device) shown at Steps S606 to S620 as with Steps S306 toS320 of the control method shown in the above-described embodiment (FIG.3).

That is, by the arithmetic processing section 140 transmitting anauthentication instruction signal to the earphones with the microphoneserving as the audio device 200 (Step S606), an authentication wave isoutputted into each earhole of the user from the earphones with themicrophone (Step S608). Next, when an echo wave occurred by reflectioninside the user's earhole is received by the earphones with themicrophone (Step S610) and transmitted as an echo signal (Step S612),the arithmetic processing section 140 executes personal authenticationprocessing which identifies the user based on authentication informationincluded in the echo signal (Step S614). When the user is identified bythe personal authentication processing and authenticated (Yes at StepS614), the arithmetic processing section 140 permits access to thepersonal data of the user (Step S616), and executes a learning plan or afunction using the personal data (Step S618).

Conversely, when the user using the electronic device 100 is notauthenticated (No at Step S614) in the above-described personalauthentication processing (Step S614), the arithmetic processing section140 may execute the same processing operations (not permit access topersonal data, non-authentication notification and end of use of theelectronic device) as those of Steps S322 to S324 of the control methodshown in the above-described embodiment (FIG. 3), or may execute aseries of processing operations of Steps S622 to S626 shown in theflowchart of FIG. 6.

That is, when the user of the electronic device is not authenticated,the arithmetic processing section 140 does not permit access to personaldata registered in advance (Step S622), and executes a learning plan ora function supporting the input or output of a voice or the like in aset state where personal data is not used (Step S624).

Here, the learning plan at the above-described Step S624 which does notuse personal data is described using English-conversation learning shownin FIGS. 4A and 4B as an example. When the user selects an arbitraryitem on the menu list on the home screen displayed on the displaysection 110 of the electronic device 100 as shown in FIG. 4A (a), forexample, the arithmetic processing section 140 executes the selectedlearning plan in a set state where the user's personal data is not used.For example, when the user selects “PRONUNCIATION TRAINING”, thearithmetic processing section 140 controls the display section 110 toperform display for inputting execution conditions and the like for thelearning plan (“QUESTION SETTING METHOD” shown in FIG. 4A(c) and “RANGEOF QUESTIONS” shown in FIG. 4A(d)). Here, since a past record withrespect to the user's learning plan is not referred to in the set statewhere personal data is not used, an item of “UNTRIED QUESTIONS” is notdisplayed on the list of the range of questions shown in FIG. 4A(d) and,for example, only items of “difficulty” is displayed.

Then, when the user inputs arbitrary execution conditions and the like,the arithmetic processing section 140 gives an example sentence based onthese conditions as shown in FIG. 4A(e) by displaying it on the displaysection 110, and replays and outputs a model voice via the audio device200 as with the above-described embodiment. When the user inputs theexample sentence via the audio device 200 after the replay of the modelvoice, the arithmetic processing section 140 records this user's voiceas shown in FIG. 4A(f), and executes pronunciation analysis processingbased on comparison between the user's voice data and the model voicedata for the given example sentence, as shown in FIG. 4B(g). The resultof the pronunciation analysis processing is displayed on the displaysection 110 in the form of a circle graph, etc. which are easier tounderstand, as shown in FIG. 4B(h).

Here, in the set state where personal data is not used, no past recordwith respect to the user's learning plan is referred to. Therefore, theanalysis result of the “last time” shown in FIG. 4B(h) is not displayedand only the result of this time is displayed. In addition, the analysisresult (namely, learning result) of this time is not stored as a pastrecord because the user has not been authenticated.

Then, when the electronic device is not ended (is continued to be used)after the end of the learning plan without personal data (No at StepS626), the arithmetic processing section 140 returns to Step S624, andcontinues the state where a learning plan which does not use personaldata can be executed. On the other hand, when completing the use of theelectronic device (Yes at Step S626), the arithmetic processing section140 ends or suspends all the operations in the electronic device so asto end the use of the electronic device.

Note that, when the earphones with the microphone which has beenconnected to the electronic device 100 is removed in the externalmicrophone mode as shown in FIG. 5, the arithmetic processing section140 changes the current mode setting to enter the main body microphonemode so as to set the state where the input or output of a voice or thelike from the built-in sound section in the electronic device 100 isenabled.

At Step S604, in a case where earphones without a microphone areconnected as the audio device 200 to the I/F section 130 (No at StepS604) in the connection judgment processing (Step S604) of theabove-described audio device 200, the setting of the external microphonemode is maintained as it is. However, since the earphones are an audiodevice to which a voice or the like cannot be inputted (that is, theyare not suitable for authentication information acquisition processing),the arithmetic processing section 140 prohibits access to the personaldata of the user without executing personal authentication processing(Step S628), and executes a specific learning plan or a function wherepronouncing is not required (Step S630). Here, for example, a list ofexample sentences is displayed on the display section 110 of theelectronic device 100 and the user selects an arbitrary examplesentence. Then, the arithmetic processing section 140 displays theexample sentence on the display section 110, and replays and outputs amodel voice therefor via the earphones without a microphone. That is, inthis state, a learning plan specialized in listening is executed.

(Main Body Microphone Mode)

In the case where the electronic device 100 is in the “main bodymicrophone mode” which enables the input or output of a voice or thelike via the built-in sound section as shown in FIG. 5, when earphoneswith a regular microphone is connected to the I/F section 130 as theaudio device 200 (Yes at Step S604), the arithmetic processing section140 displays on the display section 110 a message prompting the user todetermine whether to change the current microphone setting from a mainbody microphone to that of earphones with a microphone as shown in theflowchart of FIG. 6. Then, when the user changes the microphone setting,the arithmetic processing section 140 changes the current mode settingfrom the main body microphone mode to the external microphone mode, sothat the electronic device 100 enters a state where the input or outputof a voice or the like by the earphones with the microphone connectedthereto is enabled. Hereinafter, a series of processing operations isexecuted which is the same as that performed when earphones with aregular microphone is connected in the above-described “externalmicrophone mode” (authentication information acquisition processing,personal authentication processing, learning plan execution operation,and judgment as to the end of the electronic device at Steps S606 toS620).

Note that, when the earphones with the microphone which has beenconnected to the electronic device 100 is removed in the main bodymicrophone mode as shown in FIG. 5, the arithmetic processing section140 maintains the current mode setting as it is and sets the state wherethe input or output of a voice or the like from the built-in soundsection in the electronic device 100 is enabled.

At Step S604, in a case where earphones without a microphone areconnected as the audio device 200 to the I/F section 130 (No at StepS604) in the connection judgment processing (Step S604) of theabove-described audio device 200, the setting of the main bodymicrophone mode is maintained as it is, and the state of the electronicdevice 100 is maintained in which the input of a voice or the like viathe microphone of the sound section is enabled. Here, since the input ofa voice or the like by the earphones without the microphone cannot beperformed (that is, they are not suitable for authentication informationacquisition processing), the arithmetic processing section 140 prohibitsaccess to the personal data of the user without executing personalauthentication processing (Step S628), and executes a specific learningplan or a function requiring the input or output of a voice or the likevia the microphone of the sound section and the earphones without amicrophone connected to the I/F section 130 (Step S630). That is, inthis state, a learning plan or a function supporting the input or outputof a voice or the like is executed in a set state where the user' spersonal data is not used, as with the above-described Step S624.

As such, in this modification example, in the electronic device 100using the built-in sound section and the audio device 200 connectedexternally, acoustic means for inputting or outputting a voice or thelike can be appropriately set, and the propriety of access to thepersonal data of a user or the propriety of the use of the personal datain a learning plan or the like can be set based on various types ofconditions.

As a result of this configuration, only by wearing acoustic means inears as a series of learning preparations without adding new componentsto the electronic device and without performing an operation aimed onlyat personal authentication, the user can execute personal authenticationprocessing which automatically and appropriately identifies the userbased on an operation mode (the external microphone mode or the mainbody microphone mode) set in the electronic device and acoustic meansused for a learning plan and the like, and can favorably view or updatethe personal data of the user, or use a learning plan or a functionusing the personal data. Accordingly, even if the electronic device 100is stolen or lost, personal data such as a learning plan and theprogress thereof and an achievement level (results) of learning are notdisclosed.

(Explanatory Notes)

In the embodiment and the modification example described above, personalauthentication processing that specifies a user based on acousticproperties inside the earholes is executed using the audio device 200having inner or canal type earphones structured to be inserted intouser's earholes. However, the present invention is not limited thereto.That is, the present invention may have any structure as long asbiological information unique to a user can be acquired asauthentication information by an audio device that is worn on a user'sear portion or head portion. For example, as this audio device,headphones with an encapsulated or open type microphone can be used aslong as biological information acquired as authentication informationfulfills conditions such as the accuracy or amount of informationavailable to personal authentication processing.

Also, in the present embodiment, the case has been described in whichpersonal authentication is performed for one (single) user. However, thepresent invention is not limited thereto and is favorably applicableeven when a plurality of users shares one electronic device. In thatcase, in personal authentication processing, authentication informationacquired by the audio device 200 worn on a user is compared with eachuser's authentication information registered in advance, whereby thecurrent user of the electronic device is identified, and only access tothe personal data of this authenticated user is permitted from among aplurality of personal data registered for every user in advance. Then, alearning plan or a function using the personal data is executed.

Moreover, in the present embodiment, personal authentication processingwith respect to a user is executed by the arithmetic processing section140 of the electronic device 100. However, the present invention is notlimited thereto and, for example, personal authentication processing maybe executed by a server on a network. In recent years, as acountermeasure to information disclosure and the like, a system has beenincreased in which important information or confidential informationsuch as accounting information and customer data are stored not in aninformation processing system but in a server on a network. In thepresent invention as well, a configuration may be adopted in whichpersonal data of one or a plurality of users registered in advance arestored not in the memory section 150 in the electronic device 100 but ina server on a network, and personal authentication processing of a useris executed on the server. By this configuration, the structure of theelectronic device 100 can be simplified, a processing load thereon canbe significantly reduced, and reliability related to its security can beimproved. In a traditional method using biological information, anauthentication device is required to be provided, which may be large inscale. In addition, in the case of fingerprint authentication or veinpattern authentication, a glove or the like is required to be removed.In the case of face authentication, a mask or the like is required to beremoved. However, the present invention does not have theserequirements.

Furthermore, in the present embodiment, the electronic device usingearphones with a microphone has been applied to an electronic learningdevice such as an English-conversation learning machine or an electronicdictionary. However, the present invention is not limited thereto andmay be applied to other electronic devices having an equivalentfunction, such as a smart phone, a tablet terminal, a portable gamemachine and the like. In addition, as personal data for which thepropriety of access is judged by personal authentication processing,past records in English-conversation learning such as learning plans andlearning results have been described. However, the present invention isnot limited thereto. That is, the above-described personal data may beany data as long as it can be used by an electronic device havingearphones with a microphone and is information unique to a user.Accordingly, the present invention may be applied to medical equipment,health-care administration apparatus and the like which measure a bodytemperature or a pulse by a sensor inserted into an inner ear, and storethe results as personal data. While the present invention has beendescribed with reference to the preferred embodiments, it is intendedthat the invention be not limited by any of the details of thedescription therein but includes all the embodiments which fall withinthe scope of the appended claims.

What is claimed is:
 1. An electronic device comprising: a processor,wherein the processor, when an audio device is connected which has asound emission section which outputs a sound and a sound receptionsection in which a sound is inputted, instructs the audio device toacquire unique authentication information, and wherein the processorperforms personal authentication of a user wearing the audio devicebased on the authentication information from the audio device.
 2. Theelectronic device according to claim 1, wherein the processor controlspropriety of access to personal data of the user stored in advance andan execution status of an operation using the personal data, based on aresult of the personal authentication.
 3. The electronic deviceaccording to claim 2, wherein the processor, when the user is identifiedby the personal authentication, permits the identified user access tothe personal data, executes the operation using the personal data of theuser, and stores new personal data acquired during the operation in amemory, and wherein the processor, when the personal data of the userstored in advance exists, provides information regarding a comparisonbetween the personal data of the user stored in advance and the newpersonal data acquired during the operation.
 4. The electronic deviceaccording to claim 2, wherein the processor does not permit the user toaccess the personal data, and executes an operation which does not usethe personal data, when the user is not identified by the personalauthentication.
 5. The electronic device according to claim 2, whereinthe processor inputs pronunciation data inputted into the audio deviceor outputs pronunciation data to the audio device, as the operationusing the personal data.
 6. An audio device comprising: a sound emissionsection which outputs a sound; and a sound reception section in which asound is inputted, wherein the audio device, when an electronic deviceis connected thereto, outputs to the electronic device uniqueauthentication information acquired in accordance with an instructionreceived from the electronic device so as to acquire the authenticationinformation.
 7. The audio device according to claim 6, wherein the audiodevice outputs an acoustic wave having a specific frequency andtransmits, to the electronic device, authentication information based onan echo wave created by the acoustic wave being echoed in a user wearingthe audio device.
 8. The audio device according to claim 7, wherein theauthentication information is acoustic properties based on a waveform ofthe echo wave created by the acoustic wave being outputted into eachearhole of the user and reflected in accordance with an inner shape ofthe earhole.
 9. A control method for an electronic device, comprising:transmitting an instruction signal to an audio device connected to theelectronic device; acquiring, from the audio device, uniqueauthentication information of a user based on an echo wave of a soundoutputted from the audio device to the user wearing the audio device inresponse to the instruction signal; and performing personalauthentication of the user based on the authentication information. 10.A non-transitory computer-readable storage medium having stored thereona program that is executable by a computer in an electronic device toactualize functions comprising: transmitting an instruction signal to anaudio device connected to the electronic device; acquiring, from theaudio device, unique authentication information of a user based on anecho wave of a sound outputted from the audio device to the user wearingthe audio device in response to the instruction signal; and performingpersonal authentication of the user based on the authenticationinformation.